NASA Technical Memorandum 39453 • 



Adaptive Control and Noise 
Suppression by a Variable-Gain 
Gradient Algorithm 

S.J. Merhav and R.S. Mehta 


June 1987 


(NASA-TH-89453) ADAPTIVE CCN1ECL AND HOIS! 
SCPPfiESSICN BY A Y ARI AfcLE-GAI* GEADIENT 
ALGORITHM (NASA) 43 p Avail: STIS HC 
A 03/HI AC1 CSCL 12B 

G3/66 


N87-27477 


Unci as 
0091311 


l\lAS/\ 

National Aeronautics and 
Space Administration 


NASA Technical Memorandum 89453 


Adaptive Control and Noise 
Suppression by a Variable-Gain 
Gradient Algorithm 

S.J. Merhav, Israel Institute of Technology, Haifa, Israel 
R.S. Mehta, Ames Research Center, Moffett Field, California 


June 1987 


f\l/\SA 

National Aeronautics and 
Space Administration 

Ames Research Center 

Moffett Field, California 94035 




List of Symbols 


d 

dt 

D,D' 

e 

f 

9 

G 

G c 

G, 

i 

3 

M 

M w 

n 

n f 

N 

N' 

P 

r(-) 

rms(-) 

R 

Re(-) 

s 

tr(-) 

AT 

Tf 

T m 

T u 

u 

V 

uar(-) 

w 

w t 

X 

y 

z 

Zm 

Zr 

a 

€ 

e 

fa 

£< 


desired filter output 

integration time step in seconds in computer simulation 
characteristic polynomial in noise suppression schemes 
filter error 

factor used in calculating adaptation gain 

delay operator 

adaptive controller 

copy of adaptive controller 

compensator including integral control 

subscript index of filter weight 

iteration number 

open loop reference model 

misadjustment of filter weights 

output referred noise — without noise suppression 

output referred noise — with noise suppression 

number of filter weights 

subset of N , used in variable gain scheme 

the unknown plant 

relative degree of 

root mean square of 

correlation matrix of input to FIR 

real part of 

differential operator 

trace of 

discretization time in FIR 
length of FIR 

closed loop reference model 
actual closed loop system 
input control signal 
measurement noise 
variance of 
process noise 
i-th filter weight 
filter input 

filter output, output of adaptive controller 

plant output 

measured plant output 

output of closed loop reference model 

measure of effectiveness of noise suppression 
system error used for noise suppresion 
measure of filter error used in variable gain scheme 
saturation of e in variable gain scheme 
threshold in variable gain scheme 
damping factor 
eigenvalue 

iii 


PRECEDING PAGE BLANK NOT FSLW c f> 


OA 

T 

r, 

a; 

w,4 


FIR 

IIR 

LMS 

PSD 

RLS 


gain of adaptive algorithm 

standard deviation of signal A 

adaptation time constant in number of iterations 

settling time of adaptation algorithm in seconds 

natural frequency 

cut-off frequency of system A 


Acronyms 

Finite Impulse Response 
Infinite Impulse Response 
Least Mean Squared 
Power Spectral Density 
Recursive Least Squares 


IV 



SUMMARY 


An adaptive control system based on normalized variable-gain LMS filters is investi- 
gated. The finite impulse response of the nonparametric controller is adaptively estimated 
using a given reference model. Specifically, the following issues are addressed: The stability 
of the closed loop system is analyzed and heuristically established. Next, the adaptation 
process is studied for piecewise constant plant parameters. It is shown that by introducing 
a variable-gain in the gradient algorithm, a substantial reduction in the LMS adaptation 
rate can be achieved. Finally, process noise at the plant output generally causes a biased 
estimate of the controller. By introducing a noise suppression scheme, this bias can be 
substantially reduced and the response of the adapted system becomes very close to that 
of the reference model. Extensive computer simulations validate these and demonstrate 
assertions that the system can rapidly adapt to random jumps in plant parameters. 


1 INTRODUCTION 

One of the primary goals in current control-systems research is the achievement of robustness 
to plant-parameter uncertainties and variations. The principal approaches are robust and 
adaptive control. In recent surveys and texts [l], [2], [3] , a nominal parametric plant 
model, describable by a finite state space equation, is assumed in the computation of the 
controller. The convergence and stability of the closed-loop system depends on the realism 
of this model, specifically on the correctness of the order and relative degree of its input- 
output transfer functions [4] . 

The difficulties in assuring the realism of the plant model have thus far prevented the 
analytical accomplishments in adaptive control theory from translating into design meth- 
ods for practical processes. This paper explores an alternative approach to adaptive control 
design through implementation of a “nonparametric” finite impulse response (FIR) realiza- 
tion of the controller. At the expense of excluding nonminimum phase plants and assuming 
that, if necessary, stability can be provided by an inner feedback loop, it is demonstrated 
that the nonparametric FIR approach can provide a highly robust controller. 

The advent of adaptive filters [5|, [6], and their successful applications to identifi- 
cation and noise cancellation [7], and more recently to interference suppression in control 
systems [8], [9], has spurred interest in applying self-adjusting finite impulse response (FIR) 
filters as a building block in model reference adaptive control (MRAC) systems [10], [11], 
[12]. In this approach, the realization of the controller is not subject to the stringent condi- 
tions required in the parametric realizations. The large number of weights used in the FIR 
provides great flexibility and makes the controller insensitive to uncertainties in the order 
and the relative degree of the plant model. 

In these previous studies, the controller is directly identified by means of an open-loop 
reference model and it converges to a filtered inverse of the plant. This implies adaptive pole- 
zero cancellation. Consequently this method is restricted to stable or stabilized minimum- 
phase plants. In the present paper, which is based on [10] and [11], the same restriction 
holds. A major problem in the integration of adaptive FIR filters into closed-loop control 
systems is the possible violation of the linearity of the error equation, which is a necessary 
condition for the global and uniform convergence of the adaptive algorithm. For this and 


other reasons, this approach in earlier work, such as [12], has resulted in open-loop control 
configurations only. In [10], the integration of FIR adaptive filters in closed-loop MRAC 
systems is studied in detail and in [11], a heuristic argument for the global convergence and 
stability of the closed-loop system is given. 

The penalty for the robustness of adaptive FIR realizations such as LMS or recursive 
least squares (RLS) is a relatively slow adaptation to plant parameter variations. The reason 
for this slow adaptation in LMS or RLS realizations, [13], is that rapid adaptation involves 
a large weight noise which results in deteriorated system response. This conflict cannot 
be resolved in a conventional LMS or RLS realization in which the adaptation gain or 
the forgetting factor, respectively, is constant. In this paper we present a “variable gain” 
algorithm which resolves this conflict to a great extent. As a result, substantially faster 
adaptation rates can be achieved. 

Another issue is that process noise causes bias in the FIR estimate of the controller. 
This bias can cause substantial distortion of the closed-loop response [10]. In this paper we 
present a noise suppression scheme which substantially reduces controller bias. This scheme 
permits the independent design of system response and noise suppression without resorting 
to prefiltering methods which involve an undesirable increase in system order. 

Throughout this paper, the conventional LMS algorithm is the basis of analysis and 
computer simulation. Recent results in fast recursive least squares (FRLS) [13], [14] indicate 
that a further increase in adaptation rate and precision in parameter tracking is possible. 
It is expected that if FRLS is implemented with an adaptive forgetting factor, analogous 
to the variable-gain LMS presented in this paper, a still further increase in adaptation rate 
can be achieved. 


2 MODEL REFERENCE ADAPTIVE CONTROL USING 
THE LEAST-MEAN-SQUARE FILTER 


In this section, the basic control system, in which an LMS filter is used as the controller 
in a model reference adaptive control scheme, is reviewed. An analysis of its properties, in 
particular the effect of noise, leads to the improvements in the control system addressed in 
following sections. 


2.1 The Adaptive Finite Impulse Response Model 

It is well known that the continuous, i.e., infinite, impulse response (IIR) of a system can be 
represented by a finite set of parameters by truncating and discretizing the response. The 
fidelity of the FIR depends on the fineness of discretization AT and the length of time Tj 
before truncation. The FIR is expressed in the form of a moving average model as shown 
in (fig. 1). The input to the model is sampled. Then the present and past N — 1 values 
are stored in a tapped-delay line. These values are then weighted and summed to form the 
model output yj. The symbol g represents an operator which produces a given length of 
delay. The model contains two parameters — the number of weights N and the length of 
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the delay g. Equation 1 describes this model at time j : 


where 


N - 1 

yj = Y w tj9' x 3 = 

»=0 


g Xj — Xj-x 


Wj = 


A 

A 


w 0] W 1} . 

•• W (N-l)j ] 

■1 2 

Xj Xj - 1 . 

■■ Zj-(N-l) \ 


( 1 ) 

( 2 ) 


The weights tt>, also have the subscript j , to indicate their time-varying character. 
The model can be made adaptive by including an algorithm which adjusts the weights so 
that yj matches a desired signal dj as shown in figure 1. The adaptation is implemented 
by a gradient algorithm. The combination of the moving average model and a gradient 
algorithm is known as the LMS filter [7], 


The filter error equation, where dj is the desired output, is 

e j = dj ~Vj = dj - wj Xj (3) 

The weights are adjusted by minimizing the square of the filter error e? as follows : 


Wj+ 1 = Wj + Aw } 


de j 

A **■ = 


= -2 nej 


dtj\ 


1U) 


The gradient of the error can be derived from equation (3) 


d tj I 


d W \yy=Wj 


— X: 


leading to a weight-update equation 


(4) 

(5) 


( 6 ) 


A Wj = 2 jiejXj (7) 

where /z is a gain factor that is chosen in consideration of the stability of the gradient 
algorithm. In the traditional LMS filter, y is a constant. The properties of the LMS filter 
have been studied extensively [3], [5]. Some of them are summarized in section 2.4. This 
paper introduces an algorithm that allows a variable y. One important aspect of the LMS 
filter is the assumption inherent in equation (6), which is that neither the desired signal d 
nor the input to the filter x are functions of the filter weights Wj . 


2.2 The Control System Configuration 

Although the LMS filter itself is a discrete system, the entire control system will be analyzed 
as a continuous system. The fundamental building block of the model reference adaptive 
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control (MR AC) in this paper is shown in figure 2 where s = is the differential operator, 
P(s) is the unknown plant, M(s) is a reference model, and G(s) is the controller which 
adapts such that P(s)G(s) — > M(s) to minimize the error e. The input signal is u and the 
plant output is z. The controller G(s) and its associated adaptation algorithm are modeled 
as an LMS filter. It is clear from figure 2 that the signals d and z are independent of to,, 
which are the weights in G, and that e is linear in to* satisfying the assumptions of the LMS 
filter. 


To obtain open-loop control, an exact copy of G, G c , is placed before P (fig. 3). 
The controller G c now provides open-loop control of P\ once G has properly adapted, the 
input-output relation (from u to z) is determined by GP = M. It is apparent from figure 3 
that both d and z are now dependent on W{. This essentially violates one of the basic 
assumptions of the LMS filter. The issue will be addressed in the next section. 

In figure 4, closed-loop control is achieved by feeding back the signal y. Controllers 
G and G c now forms a controller with unity feedback. The signals w and v represent process 
noise and measurement noise, respectively. The block T m represents the desired closed-loop 
response of the system; its output is z r . 

The additional operator G, provides integral control. It is needed to satisfy the 
following two requirements: 


1. lim s _ 0 T m (s) =- 1 

2. limj,_o M(s) = constant 


The first requirement is a standard specification for closed-loop control. The second is to 
assure the realizability of G. Requirement 2 specifies that M, and by implication G, should 
not incorporate a free integrator. If that were the case, its infinite impulse response could 
not have been represented by a finite impulse response. With GP = M, the closed-loop 
reference model Tm is : 


MG, 

1 + MG, 


( 8 ) 


which satisfies requirements 1 and 2. 


2.3 Convergence 

The signals d and z in figure 4 are dependent on the filter weights u>; and therefore the 
convergence of the LMS filter is not assured. Because of this, it was initially reasoned 
[10], [11] that the system should be started in the adaptive-element mode (fig. 2) and 
then switched to the closed-loop control configuration (fig. 4) after the controller G had 
converged. However, the system can converge completely in the closed-loop configuration. 
A heuristic argument for this convergence, which is given in [11], is summarized here. 

For the following discussion, we will assume that there is no noise and that Gj is 
given by 

c, = 1 (9) 

s 
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The filter error at the jf-th iteration is 


and the error gradient is 


(M - GP)G 
s + GP Uj 



Ms - GP(2s + GP) 
(s + GP) 2 



-D T g'uj 


which can also be written as 



J!Ji G(s + GP) 9 e * 
= -Dig' uj 


( 10 ) 


( 11 ) 


( 12 ) 


Comparing equation (12) with equation (6), which is the required expression for the error 
gradient for the LMS filter, we note that g'zj represents x, and that the difference lies in 
the second term in equation (12). It is not possible to compute the second term. Therefore, 
only the first term is used in the system implementation. The theoretical and implemented 
error-gradients are indicated by the use Dt and Dj, respectively. 


It is obvious that when the filter has converged correctly and the error e ; is small, 
Di will provide approximately the correct value (- g'zj ) for the error gradient. However, 
the question is whether ej — > 0 as j —* oo. In [11] it was shown that for a specific example, 
D i was close to Dt even with large errors in the filter weights, as at the start of adaptation. 
This was done by comparing the Bode phase and magnitude responses of Dt and Dj. The 
analysis indicated that the contribution of the second term in equation (12) was small and 
that the implemented error-gradient Dj was sufficiently accurate for the convergence of the 
filter. This analysis has been confirmed by many computer runs using different plants and 
reference models, all of which have converged. 


2.4 Parameter Choices and Tradeoffs 

In the design of the control system shown in figure 4, it is necessary to choose the reference 
model M and the LMS filter parameters N , AT, and /x. 


2.4.1 Reference Model 


The reference model M is selected in accordance with standard control-system-design prac- 
tices subject to the condition that r(M) > r(P), where r(-) stands for the relative degree. 
For example, if G, in equation (8) is chosen as G, = 1/s, then 


M 

s + M 


(13) 


and r(T m ) = 
G{ is 


r(M) + 1. However, if it is desired that r(T m ) = r(M), then a valid form for 


Gt = 


ai(s -f qq) 
s 


(14) 
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resulting in 


( 15 ) 


Ql (s + Qq)M 
s + ai(s + ao)M 

Generally, T m is specified; M and Gi are computed as demonstrated in section 3. 


2.4.2 Filter Parameters 


The adaptation process adjusts G so that GP — + M. Therefore, ideally G — M/P. This 
means that the characteristic equation of G includes the poles of M and the zeros of P. 


In the discussion in section 2.1, we noted that the fidelity of the FIR depends on 
its length T/ and the time increment AT. To ensure a sufficiently small truncation error, 
the following design rule will be adopted: let Re(X min ) be the real part of the smallest 
eigenvalue of M(s ), then choose Tj such that 

Tr > -7 — tv r 

This ensures a truncation error of less than 2% [10]. If the bandwidth of the filter input 
signal z is u>, the sampling theorem would require the following condition: 


(16) 


AT < 


2x 
2 u> 


n 

uj 


(17) 


However, in accordance with control-system-design practice for stability and robustness, 
frequency components up to 10 times the open loop cutoff frequency um should be repro- 
duced. Since GP = M, a conservative requirement is that G should reproduce all frequency 
components up to IOouaj ■ This leads to 


AT < 


2x 


2(10w m ) 


n 

10 u >m 


(18) 


In general, equation (18) is more limiting than equation (17). Once the filter length Tf and 
tap spacing AT have been chosen, the number of weights is given by 


N 


Il + 1 

AT 


(19) 


So, the number of weights in the FIR is determined by the desired degree of fidelity of 
the FIR to the ideal I1R. The use of fewer parameters than those required by equations (16) 
through (19) will provide reduced, but perhaps still acceptable, performance. In principle, 
fewer parameters can be used without sacrificing performance by using nonuniform tap 
spacing [10]. 

The gain factor fi is chosen to assure the stability of the adaptation process. Define 
Rj as the correlation matrix of the input to the FIR: 

Rj = XjxJ (20) 
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where x ; is the vector of the signals at the delay-line taps, (fig. 1). The matrix Rj is real, 
symmetric and non-negative definite. It can be shown [5] that to ensure stable convergence, 
a sufficient condition is 

0 < n < t — ( 21 ) 

Amax 

where X max is the largest eigenvalue of Rj. Since \ max is difficult to calculate, equation (21) 
is replaced by 

0 < " < < 22 > 

where tr(Rj) is the trace of Rj. Since tr(Rj) > A maI , equation (22) is more conservative 
than equation (21). In practive, p is determined by 

"’ = 7 ^) ' ;>1 ,23) 

The factor / is chosen by the designer. It can be shown [5], that the average exponential- 
convergence time constant in terms of the number of iterations is given by 

r = UL 

T 4 

An additional factor which is involved in the choice of n is the misadjustment factor M w , 
which is defined as the excess parameter noise Aw m in w over the noise in the asymptotic 
Wiener solution [5]. It is given by 

Mm = y (25) 

Thus the choice of / involves a fundamental conflict. A small / provides fast convergence 
but results in large parameter noise; conversely, a large / provides accurate convergence 
(low parameter noise) but takes longer to converge. 

It should be noted that there exists a direct relation between the response time of 
the reference model M and the speed of convergence of the controller G . The convergence 
time, in seconds, of G can be determined from equation (24) by 



T t = (4r)AT = fNAT (26) 

Substituting equation (19) into equation (26) gives 

fs = 1 (!r + 0 AT * fTf (27) 

Since the smallest eigenvalue of M determines Tj, (eq. (16)), the faster M is, the smaller 
the resulting value of r,. Thus, the choice of M is instrumental in the speed of adaptation 
of G. 


2.5 Effect of Additive Noise 

Additive noise, whether process noise or measurement noise, produces errors in the estima- 
tion process and biases the filter weights. These effects are easily seen by an examination 
of the adaptation algorithm equations. With regard to the effects on the weights of the 
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controller, process and measurement noise can be grouped together [10]. From figure 4, the 
input to the LMS filter is z m . 

Zm, = Zj + rij (28) 

where rij represents the noise in the plant output caused by both Wj and Vj. The weight 
update produced by equation (7) is 


Atuy = Wj+i - Ulj = 2 tiejZn^ (29) 


where 

A r 

] T 



z mj — [ Z m y Z m y_, 

• ‘ ' 2m y-(iv-i) J 


Since the filter error is 

e j = d i ~ 

T 

Zmj Wj 

(30) 


A Wj = 2 ndjZrnj 

- 2 ^ZmjZrJ^Wj 

(31) 


As the system converges, A Wj —> 0, we obtain 

0 = 2 fiE^djZm^ - 2 pE^mj^w 0 ] (32) 

If p is small, the weights converge to a constant vector w° given by 

— = ^ \ Zm j Zm j ] ^ z mj (33) 

Assuming that n is uncorrelated with z and d 

w° - E + rijnj E (34) 

If there were no noise, the weights would settle to the Wiener solution w” 

= E[zjzj] 1 E\d j z^ (35) 

Comparing equations (34) and (35), we see that n causes a bias in w°. From equation (34) 
it follows that w° < w* . 

The effect of noise is also reflected in the weight update equation (eq. (31)), which 
can be expanded to 

At Oj = 2 ndjizj+n,) ~ 2 v{z j + n j )(z j + n j ) T w j (36) 

in which the component due to the noise is 

Aw n . = 2 fidjtij - 2fi(zjnJ + n } zj + n J nJ)u; J - (37) 

The noise also affects the filter output. 

y 3 = —my —j = Uj + tLj) T {w° + Aw n .) (38) 

The component due to noise is 

Vn ; = Zj (A w n .) + nj ( jk° + A w nj ) (39) 
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If the misadjustment noise A w m . due to M w is included, the noise component of the filter 
output becomes 

y n , = zj (A w m] + Aw n .) + nj (u>° + A w m . + Au; n> ) (40) 

Equation (40) shows that the effect of noise on y is very complex and is not simply additive. 

Furthermore, equation (40) shows that the noise component y nj in yy is a combination 
of additive and modulative terms. To reduce the intensity of noise in the system output z mj 
as well as to reduce its effect on biasing G, a scheme for noise suppression is investigated 
in the next section. 


3 NOISE SUPPRESSION BY INVERSE MODELING 

In section 2.5, the effect of system output noise n on the bias of the controller G was 
indicated. Such bias may affect the correct convergence GP — + M, and consequently 
distort the desired closed-loop response of T. For this reason, and because a fundamental 
objective is to suppress output noise, this issue is addressed in this section in conjunction 
with adaptive control. 


3.1 Noise Characteristics in Linear Time Invariant Systems 


Consider a stable, linear, time-invariant system described in SISO transfer function form 
T u (s) (fig. 5). The input is u(t) and the corresponding response z(t) is perturbed by 
output-referred additive noise n(t). It is first assumed that T u (s) is completely known. It 
can represent a closed-loop system in which a time-invariant minimum phase plant P(s) with 
relative degree r(P) > 0 is controlled by G(s) (fig. 6). Measurement noise is represented 
by v and process noise by w. 

T * \ _ z m{s) G[s)P[s) 
u[l u(s) l + G(s)P(s) 



Here G(s) is chosen to fulfill two requirements : 


1. lim T u (s) = 1 (42) 

s — *0 

2. r(T u ) > r(P) (43) 

where r(T u ) is the relative degree of T u (s). Requirement 1 may imply integral control in 
G(s). Requirement 2 implies physical realizability of G(s), i.e., 

3. r(G) > 0 (44) 

where r(G) is the relative degree of G(s). 

The noise n due to v is given by : 

n(,) = 1 + G (sj p( s j ’ W = T ’ {sHa) (45) 
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and n due to w is 


" (s) - HCgPH ’ 1,1 = ™ wM (46) 

where T v (s ) and T w (s) are the corresponding noise-transfer functions. We make the follow- 
ing assumptions : 

1. The integral control implied by requirement 1 is of an order not greater than 1, i.e., 
not more than one open-loop pole at s = 0. 

2. r(G) = 0. According to requirement 2, this implies r(T u ) = r(P). 

3. r(P) > 0. 

The following observations can be made. 

1. The design of T[s) uniquely determines T u (s). 

2. From equation (45), r(T v ) — 0 and from assumption 1, T v {s) has a zero at s = 0, 
implying lim.,_o T v (s) = 0, and with r(T„) = 0, lim,,- t oo T v (s) — 1 . Thus, the low- 
frequency components due to t;(s) are attenuated in accordance with the slope of 
+20dB/decade. High-frequency components are not attenuated. Since the bandwidth 
of the control system is by far smaller than that of white measurement noise, n(s) 
due to u(s) is hardly affected by the control activity. On the other hand, uar(n), the 
variance of n, due to v is assumed to be negligibly small in its effect on biasing G. 

3. From equation (46), r(T w ) = r(P) and from assumption 1, T w (s) has a zero at 
s = 0 implying that lim 3 _»o T w (s) = 0 and that the low-frequency slope of T w (s) 
is -f 20dB/decade. It also implies that lim s _ T w (s) = 0 and the high-frequency slope 
is — 20r(P)dB/decade. 

In linear systems design, practical design considerations related to the constraints on control 
activity and to the lack of information on unmodeled modes impose limitations on the 
admissible loop-gain response GP and in view of equations (41), (45), and (46), on the 
noise suppression characteristics of the control system. 


3.2 Principle of Noise Suppression by Error Feedback 

In this section, the concept of noise suppression by error feedback in linear time-invariant 
systems is presented in two alternative forms. The analysis indicates the limitations of its 
practical implementation in linear time-invariant systems and shows the need for adaptive 
control. 

Having assumed linear-time invariant systems, the Laplace operator s will be dropped 
for simplicity of notation. It is initially assumed that the closed-loop system T u is completely 
known so that our exact model T m = T u can be realized and its inverse T^ 1 can be formu- 
lated. However, since r(T u ) > 1, T^ 1 cannot be implemented as this would imply r(T r ^ 1 ) < 1 
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which is not realizable. Instead, an approximate inverse T m l D having r{T m l D) — 0 can be 
realized. The function D is a linear transfer function with r(D ) = r(T u ) > 1 which satisfies 

lira D(s) = 1 (47) 


Consider now the system shown in figure 7. This feedback structure, also known as 
error feedback has been used in different applications whenever the problem is to suppress 
noise while avoiding any major effect on the principal input-output relationship. 


Given that 


€ — Zyyi X — T u U s Tl Tjntig 


u s = u-TjDe 
Zm — T u u a n 

and since T^ l l T m = 1 by definition, it is easily shown that : 

T u 1 - D 


Zm — 


U + 


1 -D + Tm l T u D 1 -D + T„ l T u D 


(48) 

(49) 

(50) 

(51) 


The scheme in figure 7 that yields equation (51) will be referred to as type I. Assuming that 
throughout the useful bandwidth of u and n, D = 1, and that = 1, we have from 

equation (51) 

2m 5? T m u (52) 

Thus, ideally the noise is cancelled and the response z m is dictated by the model T m , i.e., 
the noise cancellation does not interfere with the main transfer function T u . 

Equation (51) can be rewritten in a more familiar form by dividing numerators and 
denominators by (1 -- D). Thus 


Zm — 


_T*_ 

l-D 


U + 


\+Tm l T u ^ 1 + Tm l T u ^ 


n 


(53) 


The equivalent scheme representing equation (53) is shown in figure 8. This formulation 
demonstrates that the attempt to implement D —> 1, is equivalent to requiring a large 
loop gain in figure 8. This may eventually cause instability. To illustrate this, consider the 
example: 

D ( S ) = ~2 , - Q( ‘ — ( 54 ) 


s 2 + ajs + a 0 


Then, 


D 


do 


(55) 

1 — D s(s + <ii) 

which demonstrates that a o, which determines the bandwidth of D, is also the feedback loop 
gain. In root locus representation, equation(55) indicates asymptotes at ±90°. Clearly, for 
a third-order D{s), the asymptotes would be ±60° and 180°, indicating possible instability. 

An alternative implementation (type II) of error feedback for noise suppression is 
shown in figure 9. With the relations, 


e = z m - x = T u u f + n - T„ 


u 


(56) 
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Uj = u — T^ 1 2 D'e (57) 

Z m = T u U s + fl 

D 1 fulfills the same requirements as D except the requirement of equation (47). The solution 
of z m from equations (56) to (58) is 


T u (l + D») 1 

\ + Tn l T u D' U 1 + Tm 1 T u D' 


(59) 


If T~ l T u = 


1 is fulfilled, the result is 


T u u + 


1 

1 + D' 


(60) 


Thus, noise suppression is accomplished by a large gain of D' in the useful frequency range 
of n. 


It is easily verified that in scheme type I, the noise suppression is accomplished by 
“pumping” n from z m into x, whereas in type II the noise suppression is accomplished by 
the attenuation (1 + D’)~ l as shown in equation (60). However, substituting 


D' 


D 

1 - D 


(61) 


equation (59) is changed to 


Z m = T u 


1 + 


D 

1 -D 


u+ - 


1 + Tm'Tui^p “ 1 1 + ” 1 -D + Tm l T u D “ 1 1 - D + T^T U D " 

(62) 

which is identical to equation (51). Thus, given the transformation (61), schemes type I 
and type II are identical with respect to T u and to noise suppression. 

Examination of either equations (51) or (59) discloses the following: 


T u 


u+- 


1 - D 


1 . In order to assure the desired response T u (s) = z m (s)/u(s), it is required that 

T m l T u = 1 (63) 


2. If this requirement is fulfilled, it follows that 

z m - T u u + (1 - D)n 


(64) 


In general, when T u (s) is implemented by classical linear-feedback design as defined 
in equation (41), it cannot be made to provide the required robustness of T u to fulfill con- 
dition (63) under large parameter variations in P. Thus, noise suppression, as derived by 
equation (51) or (59), is practically incompatible with conventional linear feedback design. 
However, in conjunction with the concept of MRAC, in which T m is the reference model de- 
scribed in the Control System configuration section, condition (63) is assumed to be fulfilled 
throughout a wide range of parameter variations. Given this assumption, equation (64) can 
be assumed to be correct. 
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In section 3.1, it has been shown that n(s), either due to process noise w or mea- 
surement noise v, has a high-pass slope of -f-20dB/decade at low frequencies. It is easily 
verified that with the assumptions placed on D, (1 - D) has a +20dB/decade high pass 
slope. The consequence therefore is that with noise cancellation, the closed-loop system, 
in accordance with figure 7 or figure 9, now has a +40dB per decade slope with respect 
to noise. Furthermore, the frequency breakpoint of D can be made considerably higher 
than that of T u . Since, as is evident from equation (46), n due to xv is mostly a filtered 
low-frequency process, the high pass filtering by (1 - D)n in equation (64) can contribute 
to substantial suppression of process noise. 


3.3 Example of Noise Suppression 

In this section, the effect of noise suppression is demonstrated by a numerical example. 
Assume a plant P with r(P) = 2, given by 


X P O 


P{S ) = -r- 

s 2 + a Pl s + a p „ 


Let r(T m ) = r(P) = 2, and let T m be 


s + a Tl 


T m {s) = -3— 2 

s 3 + a m2 s 2 + a mj s + a m „ 

Then, with r(D) = r(T m ) = 2, and let D(s) be 

do 


D(s) = 


s 2 + di s + do 

The open-loop transfer function according to equation (8) is: 
/-i / \ \ j t \ T m (s) s -f- a m „ 

GiWM(,) = T^tJT) - 


1 


with 


Gi(s) - 


M(s) = 


S S 2 -|- dft “f" Um 1 1 

s + am,, 

s 

1 


S U m2 S + flmj 1 


(65) 

( 66 ) 

(67) 

(68) 

(69) 

(70) 


The function G,(s) is not incorporated in the open-loop reference model M(s) because the 
integrator would have required an infinitely long FIR. Instead G, is incorporated into the 
closed-loop system as a series compensator in accordance with figure 4 (see Section 2.2). 
Since in the adapted system GP — ► M, we have, in accordance with equation (46), 

P( k 8') / \ a P „(g dm2 S T~ Um.| l) / \ / j-. \ 

n S _ 1 -(- Gj(s)M(s) ^ S (s 2 + a Pl s + a p „)(s 3 + a m2 s 2 + a m ,s + a m „) 

The following values are chosen: 


P • Up i, — 25; o Pl — 1 
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T m ! Uni, — 10; dm i — 10; d m2 6.5 
D : do = 150; d\ — 20 

The plant P with the above values will be referred to as the FAST plant. The process noise 
u/(s) is chosen as zero-mean white noise with unity Power Spectral Density (PSD). The 
variance of n(s), with the above numerical values for P, T m , and D is 

var(n) — 14.722 (72) 

In accordance with equation (64), the suppressed noise is 

n s = (1 - D)n (73) 


and explicitly 


n. 


a Plt s 2 (s 2 + a m2 s + a m , - l)(s + d i) 


(s 2 + a Pl s + a p , ,)(s 3 + a m2 s 2 + a mi s + a m» )(* 2 + djs + do) 
With the above numerical values 

var(n a ) = 5.8359 

The ratio a of the rms values of n and n a is 

1/2 


w{s) (74) 


(75) 


a = = 0.62 

\ var[n) } 


(76) 


This result implies that because of the relatively high frequency of the resonant peak 
of n s , w — y/d Pll — 5 rad, n is not substantially suppressed by the noise cancellation scheme. 
However, if a Pll = 4, referred to as the SLOW plant, and all the other numerical values are 
unchanged, the result is 

var(n) = 3.104 (77) 

var(n s ) = 0.219 (78) 


and q is, 

a = 0.265 


(79) 


which is a substantial-noise suppression. The low-frequency approximate transfer functions 
without and with noise suppression as derived from equations (71) and (74) are correspond- 
ingly: 


n ( s ) ^ 4 a mi ~ !) 

w ( s ) a m„ 

(80) 

«( s ) ~ s 2 (a mi — 1) d\ 
(s) a m „ do 

(81) 


Equations (80) and (81) emphasize the trend indicated by the results given in equations (72), 
(75), (77), and (78) accordingly. Figures 10 and 11 show the frequency-response plots of 
equations (71) and (74) for the corresponding plant parameters a p „ = 25 and a pi] = 4 and 
also show the levels of noise suppression that are achieved in the two cases. 
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4 REALIZATION OF NOISE SUPPRESSION 


In section 3, suppression of additive noise by error feedback (shown in fig. 7) is presented 
for a linear system. For the fulfillment of condition (63), it is required that T u adapt so 
that T u — > T m . However, in view of equation (30) of ([10]), the additive-output noise n 
excites weight noise in addition to the intrinsic misadjustment noise in w_j. This noise is 
modulative and it combines with n in a highly complex nonlinear manner. Consequently, 
noise suppression by linear error feedback as presented in section 3 cannot be as effective as 
that predicted by linear analysis, unless the adaptation gain, p = (/tr(/i)) -1 <C 1, which 
implies a very slow rate of adaptation. This conflict between the rate of adaptation and 
weight noise is a problem which cannot be resolved in basic estimators such as LMS or 
RLS. However, by introducing a modified LMS algorithm in which the adaptation gain p is 
monotonically related to a suitable measure of the adaptation error e, this conflict can be 
resolved to a substantial degree. 


4.1 Variable- Gain LMS Filter 


The parameters of the controlled plant P(s) are regarded as piecewise-constant time pro- 
cesses, i.e., at random times, any plant parameter may undergo an abrupt step-change to a 
new unknown value. It is required that the adaptive algorithm adjusts the controller G to 
the new value of P so as to enforce GP — > M as rapidly as possible. This implies that p 
should be assigned the largest permitted value po = (Jrji?)) -1 . On the other hand, during 
the quiescent time intervals, p should be vanishingly small so as to reduce weight noise due 
to n or to misadjustment. In equation (3), ey represents the adaptation error. Its squared 
averaged value is used to determine p as follows: Let 

Po = {ftr(Rj))~ l (82) 

where / > 1 so as to fulfill the stability condition 0 < ho < (tr(i2y)) _1 and let 

3 = ( 83 ) 

3 = 1 


where N' < N , and N is the number of lags in the LMS delay line. Define 



(84) 


We now choose a monotonic function p — /i(e) as follows. Let e t and e, be the threshold 
and saturation points respectively, of e. Then, the actual p in the LMS is given by: 


Hj = 


0 ; 0 < ej < et 

Mo ; < £> < £» 

e, “ 

Mo > ^ 


(85) 


Equation (85) is illustrated in figure 12. Thus, the initial convergence after a step change 
in plant parameters is determined by Mo- For example, for / = 2, in accordance with 
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equation (24), the initial time constant of convergence in terms of the number of iterations 
is 


T = 


fN __ N 

~r ~ j 


( 86 ) 


as long as e > e s . The convergence rate then slows down with the decreasing value of fi. 
Eventually when e < e t , the weight noise vanishes and the algorithm effectively discontinues 
the weight updating in accordance with equation (85). Furthermore, s t can be set so that 
during the quiescent periods, e < et is maintained even in the presence of noise n. The 
consequence is that the introduction of the threshold e* inhibits the excitation of parameter 
noise. Accordingly, with the variable-gain LMS, the system output noise essentially retains 
its additive nature. Therefore noise suppression by linear error feedback can retain its 
effectiveness as presented in section 3. However, if plant parameters vary continuously and 
at relatively high rates, e 2 , and therefore e, cannot become small, so substantial parameter 
noise, and consequently system noise, will be present. 


4.2 System Description 

The complete adaptive-control system, incorporating noise suppression by error feedback in 
accordance with section 3, and variable adaptation gain ft = /t(e) (not explicitly shown), is 
described in figure 13. The two versions of error feedback, described in section 3.2, namely 
Type I and Type II are indicated by the solid and dashed lines, respectively. The reference 
model T r is the same as T m , and its response to u, z r , is used for comparison with the actual 
system output z. The variable e is the adaptation error driving the gradient algorithm in 
accordance with equation (7); c is the system error in accordance with equation (48) used 
for noise suppression, and n c is the output of the noise suppression loop. 


5 COMPUTER SIMULATIONS 


The results of the simulation tests presented in this section illustrate the concepts discussed 
in the previous sections. In particular, the examples demonstrate 1) the performance of 
the system without the improvements presented in this paper, 2) the effects of using the 
variable gain algorithm, and 3) the noise suppression scheme. 


5 . 1 Implementat ion 

The following parameters were used in the simulation tests. 


1. For the majority of the examples, the “unknown” plant was 


P(s) 


25 

sHs + 25 


which has a natural frequency ~ 5 and a damping factor £ = 0.1. This plant is 
occasionally referred to as the FAST plant. In some examples, a step change in gain 
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occurs. The plant after the step change is 

P(s) = 


50 


s 2 + s + 25 


There are also a couple of examples which use a SLOW plant. These use 

4 


P(s) = 


s 2 + s + 4 


which has a natural frequency w2!2 and a damping factor f = 0.25 
2. The closed-loop reference model was 

= 5 j£ 

V ‘ s 3 + 6.5s 2 + 10s + 10 
and the open-loop reference model was 

M(s) = 10 


s 2 + 6.5s + 9 

3. The ihput control signal u was a square wave with an amplitude of 1 and a period of 
10 sec. 


4. The integral controller G t (s) was 


om = 0 ' <* • 10) 


5. For the runs which included the noise suppression scheme, the filter D(s) was 


D{s) 


150 

s 2 + 20s + 150 


6. All initial conditions of the various systems were set to zero. The initial weights of 
the controllers G and G c were 


u>, 


1 i=0 

0 i = 


Note that if all the weights of the controllers are zero, the system cannot start because 
no signal gets past the G c . The above choice of weights is arbitrary. 

7. The parameters for the variable gain scheme were 


ct = 0.05 
e, = 1.00 
/ = 2 


8. The filter parameters were 21 weights ( N — 21) and the tap spacing was 0.1 sec 
(AT = 0.1), resulting in a filter with Tf — 2.0 sec. These parameters were calculated 
using equations (16)-(19) and M(s) of item 2. 

9. The weights of the controllers G and G c were updated every AT sec. 
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10. In all cases, all of the blocks (see block diagram, fig. 13) except for the controllers G 
and G c , were modelled in continuous time. A sixth-order Runge-Kutta integration 
scheme was used with an integration step size of dt = 0.002 sec. The outputs of G 
and G c were also calculated every dt sec. 

11. When included, the process noise w was zero-mean white noise, with a standard 
deviation a w of 0.2, and was sampled every dt sec. 

12. The simulations were run for 50 sec (25,000 iterations). 

5.2 Results 

Table 1 summarizes the various configurations used in the eight simulation runs; the results 
are presented in figures 14-21. 

Run 1 has the traditional LMS filter, with a constant /z and / = 2; its results 
are shown in figure 14. Figure 14a, which compares the actual and reference responses, 
demonstrates poor performance. It also shows the nonlinearity of the system with the 
response to positive steps in the input being very different than the response to negative 
steps. Figure 14b shows the time history of some of the filter weights. As expected with 
the high gain (/ = 2), the weights are very noisy. 

A smaller gain (/ = 10) is used with a constant n in run 2, figure 15. Comparing 
figure 15a with figure 14a, we note a considerable reduction in the weight noise. A step 
change in the plant gain, doubled from 1 to 2, occurs at 27.5 sec. The system adapts to 
this plant change, although the adaptation rate is relatively slow. Figure 15b shows the 
time history of some of the filter weights. It shows that the weights responded to the plant 
change. The weights are much less noisy than in figure 14b. 

The variable /z scheme is introduced in run 3. Figure 16a shows that the system 
performance is quite similar to that of run 2, of figure 15a. However, the plot of the 
weights, figure 16b, shows that the weights, once settled, are almost noise-free. Comparing 
this with figure 15b, the advantage of the variable-gain LMS is clear. However, the penalty 
one pays for shutting off the adaptation (i.e., when e < e*) can be seen in the final section 
of Figure 16(a). The adaptation has stopped after 33 sec because the filter error is small, 
but the error in the system response is still noticeable. This can be improved by reducing 
the threshold e t in the variable /z scheme. 

In run 4 the noise suppression scheme is included. However, no process or mea- 
surement noise is introduced, and therefore the noise suppression loop can be regarded as 
simply providing additional feedback. The system performance as shown in figure 17a has 
improved considerably compared with figure 16a. Furthermore, the transient caused by 
the plant change at 27.5 sec is much better than in run 3. Figure 17b, the time history of 
the filter weights, shows that the weights initially responded slightly more slowly than the 
corresponding change in figure 16b. This is caused by the noise suppression loop, which 
modifies tz to u s . The signal tz, excites the adaptive scheme to a lesser extent than u. 
Figure 17(c) shows the output of the noise suppression loop (n c in fig. 13). The significance 
of figure 17c will be discussed in section 5.3. Finally, figure 17d shows e z , the error in the 
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system output (e z = z r — z), for runs 3 and 4. The dotted line is for run 3, without the 
noise suppression loop, and the solid line is for run 4, with noise suppression. 

In run 5, process noise is added. The noise tv is zero-mean white noise with standard 
deviation a w = 0.2 and is sampled every dt sec (dt — 0.002). The noise suppression loop is 
not used in run 5. Figure 18a shows the actual and reference system output and figure 18b 
shows the time history of some of the filter weights. In spite of the presence of process 
noise, the weight noise is negligible. However, the process noise clearly corrupts the system 
output. In run 6, the same process noise was added, but the noise suppression loop was 
used. These results are shown in figures 19a and 19b. As expected, the effect of the process 
noise on the system output is much smaller in run 6. Figure 19c compares e z for runs 5 and 
6 . 


In runs 7 and 8, the SLOW plant is used, without and with noise suppression, 
respectively, with the same process noise {a w — 0.2) as in runs 5 and 6. Figures 20 and 
21a show the system responses in the two cases. Figure 21b shows the error e z for the two 
cases. 


5.3 Discussion 

In the configuration of runs 4, 6, and 8 there are in essence two feedback loops, the adaptive 
controller G and the noise suppression loop. It is important to note the differences in their 
roles. The adaptive controller has to adjust itself (its weights) such that PG — > M. The 
noise suppression loop has to minimize the undesired perturbations in system response 
caused by noise and other disturbances. For run 4, figure 17c shows the output of the noise 
suppression loop (n c in fig. 13). Clearly, the large peak caused by the plant change occurs 
before G has had time to adjust. As G adjusts, the noise suppression loop returns to its 
normal level of performance. This demonstrates that the two feedback loops are fulfilling 
their distinct roles and not interfering with each other. 

To compare the simulation results with the analysis of section 3, the root mean 
square (rms) values of e z were calculated. These are presented in table 2. For runs 3 and 4, 
rms(e z ) was calculated over the range 5 to 25 sec — after the initial transient had vanished 
and before the jump in plant gain had occurred. For runs 5 and 6, the range 5 to 50 sec 
was used. For runs 7 and 8, the range 10 to 50 sec was used. Comparing run 3 with 4, 
run 5 with 6, and run 7 with 8 shows that in each case the addition of the noise suppression 
decreased the error e z by more than a factor of 3. 

We note that there is an increase in the system error e z from runs 3 and 4 to runs 5 
and 6. This increase is caused by the addition of process noise w. The error due to w is 
statistically independent of the the error from other causes (primarily the mismatch between 
PG and M). We can now calculate the noise at the output due to process noise. By adding 
subscripts to e z to refer to run numbers, and given that n and n s represent output-referred 
noise without and with noise suppression, respectively (from section 3.3) 

- <3 = 0.042 
= 0 015 
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(87) 

( 88 ) 



The analysis of section 3.3, which assumed that the noise w had a 
in (from equations (72) and (75)) 

unity PSD, resulted 

var(n) — 14.722 

var(n s ) = 5.8359 

(89) 

The PSD of t u used in the simulation is approximately given by 


PSD(w) ~ al * dt = (0.2) 2 * (0.002) = 0.00008 

(90) 

The predicted values of a n and a n , are therefore given by 


o n = y^PSD(tc) * var(n) = 0.0343 

(91) 

o n . = ^PSD(u;) * var(n 3 ) = 0.0216 

(92) 


These values are close to the simulation results of equations (87) and (88). For the results 
to match the analysis exactly, a tir should be smaller by 5% and cr Cj( . should be 12% larger. 
These small errors can be attributed to two main causes. The first is that equation (90) is an 
approximation. Secondly, the sample size is small. The number of statistically independent 
samples in e z which have a dominant frequency of 5 rad/sec (the lightly damped mode of 
the plant) in a run of 50 sec is about 50. Therefore in runs 3 and 4 there are only about 
20 independent samples. In view of these two points, the match between the analysis and 
simulation can be considered to be very good. 


Runs 7 and 8 with the SLOW plant are equivalent to runs 5 and 6 with the FAST 
plant. Two more runs with the SLOW plant, equivalent to runs 3 and 4, were conducted 
(but not presented here) to calculate the effect of the noise. The results were 


o n = 0.011 

(93) 

On. — 0.003 

(94) 

The predicted values are 


o n = 0.0158 

(95) 

On. = 0.0013 

(96) 

These are very close to the simulation results. A change of only 2% in o tti 

and o e would 


make the results match exactly. 

The measure of the effectiveness of noise suppression developed in section 3.3 is 

" = fe) < 97 > 

For the FAST plant, use of equations (87) and (88) gives the result a — 0.36, meaning that 
the noise suppression scheme reduced the effect of process noise w by about 64%. This is 
much better than the predicted value of a = 0.62 from equation (76). The reason for the 
better-than-predicted performance is that the noise suppression scheme and the adaptive 
controller reinforce each other. The reduced level of noise leads to a more accurate C, which 
in turn leads to better noise suppression. This constructive interaction between the two 
feedback loops is one of the major advantages of the the total system. 
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To demonstrate, let a p be the predicted value of a which is based on an assumption 
of a perfect G— G p \ 


- - te® 


(98) 


By contrast, a*, the simulation result, is formed from one run with noise suppression pro- 
ducing a “good” G, G g , and one run without noise suppression producing a “fair” G, Gj\ 


Qs = 

V &n 




&f)J 


(99) 


Note that a p uses the same G for both its numerator and denominator. Assume that a p is 
a good prediction if the G is consistent. Then, using Gf 


p 

73 

II 

<5 £ 
. 3 

(100) 

Since G g is better than G j 


Vn.iGj) ^ a n,(Gf) 
a n(Gj) °n{Gf) 

(101) 

or 


ot, < a p 

(102) 

This qualitative analysis leads to the conclusion that a e 

will be lower than a p ; the noise 


suppression will be more effective than predicted because of the improvement in G. 


For the SLOW plant, the simulation result was a = 0.24. The noise suppression 
was able to reduce the effect of the process noise by about 76%. This is very close to the 
predicted value of a = 0.265 from equation (79). Again, the simulation results are better 
than predicted. In this case the difference is small because the system was able to converge 
to the correct value of G even without the noise suppression loop. 


6 CONCLUSIONS 


It has been shown that an adaptive filter can perform as a nonparametric controller in a 
closed-loop system. Although the error equation in the closed-loop system is not strictly 
linear, the system converges so as to establish a linear error equation in the adapted system. 
In the system discussed in this paper, the adaptive element is essentially an LMS filter. A 
variable gain scheme was introduced in which the gradient gain is a monotonic function of 
the adaptation error of the controller. This made it possible to have fast adaptation without 
large misadjustment noise. A model-inverse noise suppression scheme was also introduced. 
The noise-suppression and variable-gain schemes worked together in a mutually beneficial 
way to provide excellent noise suppression, system tracking, and response to plant changes. 

In the present system, the elements of the input vector to the adaptive filter are not 
orthogonal. It is anticipated that a substantial reduction in the adaptation time can be 
achieved by an adaptive filter based on an orthogonalized input vector, such as recursive 
least squares or lattice filters, with successful implementation of an adaptive forgetting 
factor. 
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TABLE 1- SIMULATION RUNS 


Run No. 

Constant or 
variable ju 

/ 

°w 

Noise 

suppression 

Step 

change 

Plant 

Figures 

1 

C 

2 

0 

No 


FAST 

14a,b 

2 

C 

10 

0 

No 


FAST 

15a,b 

3 

V 

2 

0 

No 


FAST 

16a,b; 17d 

4 

V 

2 

0 

Yes 

Yes 

FAST 

17a,b,c,d 

5 

V 

2 

m 

No 

No 

FAST 

18a,b; 19c 

6 

V 

2 

m 

Yes 

No 

FAST 

19a,b,c 

7 

V 

2 

0.2 

No 

No 

SLOW 

20; 21b 

8 

V 

2 

0.2 

Yes 

No 

SLOW 

21a,b 


TABLE 2.- ERROR IN SYSTEM OUTPUT 


FOR RUNS 3 TO 8 


Run No, 

rms(e z ) 

3 

0.104 

4 

0.026 

5 

0.112 

6 

0.030 

7 

0.052 

8 

0.013 
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Figure 1 Adaptive finite-impulse-response model. 



Figure 2.— MRAC adaptive element. 
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Figure 3.— Open-loop control system. 









Figure 6.— Closed-loop system. 
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Figure 7.— Scheme for noise suppression by error feedback, type I. 



Figure 8.- Equivalent scheme for noise suppression, type I. 
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Figure 9 — Scheme for noise suppression by error feedback, type II. 
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Figure 10.- Bode magnitude plot for output noise to input noise transfer function, FAST plant. 
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Figure 12.— Adaptation gain as a function of a measure of filter error. 
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TYPE II 



Figure 13.— Closed-loop control system with noise suppression. 
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Figure 15.- Results of Run 2. (a) Actual and reference system output, (b) Time history of some filter 

weights. 
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Figure 17.— Concluded, (c) Output of noise suppression loop, (d) Error in system output for runs 3 and 4. 
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Figure 19.- Concluded, (c) Error in system output for runs 5 and 6. 



Figure 20.- Results of Run 7. Actual and reference system output. 
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Figure 21.— Results of Run 8. (a) Actual and reference system output, (b) Error in system output for 

runs 7 and 8. 
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